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(54) Video signal decompression apparatus 

(57) For decompressing signals compressed in 
groups of frames, a video signal processor comprises 
error detection/correction means for generating error 
indications(E) for uncorrectable errors, means for map- 
ping the indications into a map with indications of pre- 



dictive encoded anchor frames being entered into 
corresponding map locations, and means for providing 
substitute image data for portions of frames having 
errors indicated by the mapped indications. 
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Description 



This invention relates to apparatus for decompress- 
ing compressed video data as for recording or transmis- 
sion. 

Over the past two decades significant effort has 
been committed to the compression of digitized video 
signals for purposes of image storage and transmission. 
As a result many types of compression techniques have 
evolved including the use of discrete cosine transforms, 
sub-band encoding, pyramid transforms, intraframe 
encoding, interframe encoding and combinations of the 
above to name a few. More recently the International 
Organization for Standardization has developed a video 
compression standard for use in video storage applica- 
tions, e.g., CD-ROM. This proposed standard is 
described in the document "Coding of Moving Pictures 
and Associated Audio", ISO-IEC JTC1/SC2/WG11, 
MPEG 90/176 Rev.2; December 18, 1990. Hereinbelow 
this system will be referred to as MPEG. 

A feature of the MPEG standard is the use of both 
intraframe and interframe coding techniques in combi- 
nation with discrete cosine transforms, run length 
encoding and statistical (Huffman) encoding. Intraframe 
encoding in general terms involves the encoding of an 
image frame from a single source frame to provide suf- 
ficient encoded data for reconstruction of an image from 
only the intraframe encoded data. Interframe encoding 
is the generation of encoded frame data from, for exam- 
ple, the differences between information from a current 
source frame and a frame predicted from prior frames. 
As such images may not be reconstructed from a frame 
of interframe encoded data without information from 
prior frames. The MPEG system incorporates two types 
of interframe encoding. The first develops predictive 
frames (designated P frames) from the current frame 
and a single prior frame. The second develops bidirec- 
tional^ predictive frames (designated B frames) from 
the current frame and one or both of a prior and a sub- 
sequent frame. For example, assume that frames occur 
in a sequence F1, F2, F3, F4... and that frame F1 is to 
be intraframe encoded (designated I frame), frames F2 
and F3 are to be B frame encoded and frame F4 is to be 
P frame encoded. The P encoded frame is developed 
from differences between frame F4 and a predicted 
frame generated from a decoded version of I frame F1 
only. The B encoded frame representing frame F2 (F3) 
is developed from differences between frame F2 (F3) 
and predicted frames generated from both a decoded 
version of I frame F1 and a decoded version of P frame 
F4. Exemplary circuitry for generating I, B and P 
encoded frames is described in "A Chip Set Core for 
Image Compression", by Alvin Artieri and Oswald 
Colavin, available from SGS-Thomson Microelectron- 
ics, Image Processing Business Unit, 17 avenue des 
Martyrs-B.R 217, 38019 Grenoble Cedex France. 

An exemplary sequence of I, B and P encoded 
frames is illustrated in FIGURE 1A. In FIGURE 1Athe 
upper blocks correspond to odd fields of interlaced 



image data, and the lower blocks correspond to even 
fields of interlaced image data. The MPEG system pro- 
tocol designates that only the odd fields of respective 
frames are to be encoded. The exemplary sequence 
5 includes 9 frames of I, B and P encoded data which 
sequences occur cyclically. The amount of encoded 
data of I frames is significantly greater than the amount 
of encoded data of P frames, and the amount of 
encoded data of B frames is less than that of encoded P 
10 frames. The number of P frames between I frames and 
the number of B frames between P or I and P frames is 
variable, i.e., it is user selectable within certain con- 
straints. Nominally this selection is dependent upon the 
channel bandwidth and image content. 
15 The level of encoding provided by the MPEG proto- 
col (e.g., odd fields only and a continuous data transfer 
rate of 1 .5 M bits/S) is sufficient to produce acceptable 
images in the computer display environment. However, 
those skilled in the art of television signal processing will 
20 readily recognize that the MPEG protocol as defined will 
not provide images of current broadcast quality. It will 
also be recognized that minor modifications to the pro- 
tocol will provide sufficient data to produce broadcast 
quality television images or even HDTV images. These 
25 changes include doubling the number of fields to be 
encoded as well as increasing the number of lines per 
field and the number of pixels per line. However, even 
with such modifications to the MPEG protocol, certain 
deficiencies will still exist to preclude acceptable per- 
30 formance with respect to image reception. 

Regarding the TV environment, a first deficiency of 
the MPEG system is the timing latency of image produc- 
tion upon receiver turn on or channel change. An image 
cannot be reproduced until an intraframe encoded 
35 frame of data is available to the receiver. For the 
sequence of encoded frames shown in FIGURE 1A, in 
the worst case, image reproduction has a latency of at 
least nine frame intervals. A second deficiency resides 
in the duration of image corruption due to corruption or 
40 loss of data in data transmission. That is, if data for an 
encoded I frame is lost or corrupted, the images repro- 
duced during the succeeding eight frames will be in 
error, which error may become cumulatively worse over 
the interval. 

45 Independently encoding the odd and even fields of 
image data such that intraframe encoded odd fields are 
located midway between intraframe encoded even 
fields can be utilized to significantly reduce the start-up 
interval and image reproduction during channel 

so changes. In addition it provides signal information which 
may be utilized for signal error concealment. 

According to the present invention there is provided 
a video signal processor apparatus of the type for 
decompressing a compressed image representative 

55 signal which has been compressed in groups of frames, 
with at least the first frame in each group of frames hav- 
ing been intraframe encoded, and ones of the remaining 
frames of each group having been predictive encoded, 
and wherein frames of respective groups of frames from 
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which other frames have been predictive encoded are 
herein designated as anchor frames, said compressed 
image representative signal occurring in segments of 
data of less than a frame and susceptible of incurring 
errors during transmission, said segments including 5 
error check bits from which errors in segments may be 
detected, said apparatus comprising; 

error detection/correction means, responsive to 
said compressed image representative signal, for 
detecting errors in respective segments of data which w 
are not correctable and generating error indications E 
for respective segments of data containing such errors; 

means responsive to said error indications E for 
mapping said uncorrectable errors in an error map, and 
propagating error indications E of said anchor frames, 15 
into corresponding map locations of successive anchor 
frames within a group of frames; and 

means responsive to said propagated error indi- 
cations for providing substitute image data for portions 
of respective frames having errors indicated by the 20 
mapped indications E. 

Brief Description pf the Drawings 

FIGURES 1 A, 1 B AND 1 C are pictorial representa- 25 
tions of encoded sequences of fields of video signal, 
useful for describing the invention. 

FIGURE 2 is a block diagram of an exemplary video 
signal encoding system embodying the present inven- 
tion. 30 

FIGURE 3 is a block diagram of an exemplary video 
signal compression apparatus. 

FIGURE 4 is a block diagram of an exemplary video 
signal decoding system. 

FIGURE 5 is a block diagram of an exemplary video 35 
signal decompression apparatus. 

FIGURE 6 is a pictorial representation of com- 
pressed signal format. 

FIGURE 7 is a pictorial representation of a field 
error memory useful for describing the invention. 40 

FIGURE 8 is a flow chart of an exemplary process 
for generating an image signal error map. 

FIGURE 9 is a flow chart of the start-up sequence 
of the FIGURE 5 apparatus. 

The invention will be described in terms of the 45 
MPEG field/frame protocol, however it should be appre- 
ciated that it is applicable to any encoding format that 
provides cyclic sequences of intraframe and interframe 
compressed signal. 

Referring to FIGURE 1A, the row of boxes corre- so 
sponds to respective fields of encoded video signal. 
Even and odd numbered boxes correspond to even and 
odd fields respectively. The type of encoding applied to 
the respective fields (I. B or P) is indicated by the letter 
above each box. As indicated above, the sequence of ss 
odd fields corresponds to the MPEG protocol. Adding 
the even fields to the sequence, increasing the number 
of lines per field and the number of pixels per line mod- 
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if ies the protocol to provide sufficient information for tel- 
evision image reproduction. 

FIGURE 1B illustrates an improved coding format, 
according to the invention, for reducing image reproduc- 
tion latency and concealing signal transmission data 
loss or corruption. In FIGURE 1B the even fields are 
encoded independently of the odd fields and the intra- 
frame encoded fields are offset by approximately one 
half the number of fields in the cyclic sequence. The 
advantages that flow from the FIGURE 1B sequence 
are as follows. To begin image reproduction an I 
field/frame is required. The sequence of FIGURE IB 
includes an I field/frame every 9 fields whereas the 
sequence of FIGURE 1 A includes an I field/frame only 
every 17 fields. Thus the FIGURE 1B sequence pro- 
vides signal entry points at intervals one-half as long as 
the intervals of the sequence of FIGURE 1A, without 
increasing the amount of coded data. An image may be 
reproduced from only even field data or only odd field 
data, albeit with half vertical resolution. However, for 
providing images during channel scans (sequencing 
through channels), and at start-up, the rapidly repro- 
duced lower resolution image is significantly more 
acceptable than waiting twice as long for a full resolution 
image. Regarding error concealment, assume that data 
is lost from a portion of the I fields 1 and 2 of FIGURE 
1A. This lost data will affect the reproduction of the 
images from fields 1-18, and may induce unacceptable 
image artifacts. Consider the loss of an equivalent 
amount of data from fields 1 and 2 of the sequence of 
FIGURE 1B. Data lost from field 2 will only affect the 
reproduced image corresponding to field 2 since field 2 
is bidirectionally predictive encoded. Data lost from the 
odd I field 1 has the potential of affecting all of the odd 
fields in the sequence, and thus corrupt all of the frames 
in the sequence. However, on detection of lost data in 
the odd field sequence, data from the even field 
sequence may be substituted for display. Such substitu- 
tion will momentarily provide less image resolution, but 
this is far more acceptable than corrupted images. 

FIGURES 1A and 1B illustrate sequences of fields 
as they normally occur (disregarding the type of encod- 
ing). FIGURE 10 illustrates afield sequence as it would 
be transmitted in an MPEG system. Recall that, for 
example, bidirectionally predictive encoded fields 3 and 
5 are generated in part from I field 1 and P field 7. In 
order to decode the B fields 3 and 5, I field 1 and P field 
7 must have been previously decoded. Therefore, to 
facilitate decoding and reduce the amount of data stor- 
age required in receivers, the encoded B fields are 
arranged to follow the occurrence of I and P fields from 
which decoding depends. This field transmission 
arrangement illustrated in FIGURE 1C corresponds to 
the coding sequence of FIGURE 1 B. 

Apparatus for encoding video signal according to, 
e.g„ the field format of FIGURE 1C is illustrated in FIG- 
URE 2. Video signal is provided by a source 10, which 
may include a video camera and preprocessing cir- 
cuitry. The preprocessing circuitry provides fields of 
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video signal according to an interlaced scan format and 
in pulse code modulated format (PCM). Typically the 
source 10 will provide luminance, Y, and chrominance, 
U and V, color difference signals, but for purposes of this 
disclosure they will be referred to jointly as the video sig- 5 
nal. Nominally the luminance and chrominance signals 
are independently compressed or encoded and then 
combined for transmission, but those persons skilled in 
the art of video signal compression will be aware of 
these techniques and readily be able to implement 10 
same. 

The video signal from the source 10 is coupled to a 
multiplexer 12 which passes even fields of video data to 
a first compressor apparatus 16 and odd fields of video 
data to a second compressor apparatus 17. The multi- 15 
plexer 12 is controlled by a system control circuit 14, 
which is responsive to field interval timing signals pro- 
vided by the video source 10. 

Compressor 16 is conditioned by the control circuit 
14 to compress respective even fields of video data 20 
according to a predetermined sequence of intraframe 
and interframe coding modes, e.g. I, B, P modes. Com- 
pressed video data is applied to a buffer memory 18. 
Compressed data from the buffer 18 is coupled to a 
transport packetizing circuit 20. The packetizing circuit 25 
20 includes circuitry for parsing the data into blocks of 
predetermined amounts of data including header infor- 
mation to identify each block as well as information such 
as Barker codes for synchronizing the detection of 
respective blocks at corresponding receiver apparatus. 30 
The circuit 20 may also include error correction circuitry 
for appending error check codes to the data to be trans- 
mitted. The error correction circuitry may be in the form 
of a Reed-Solomon error correction encoder. The trans- 
port blocks are coupled to a transmitter 21 which may 35 
be simply a data bus or as complicated as a broadcast 
transmitter. In the latter instance the transport blocks of 
data may be conditioned to quadrature amplitude mod- 
ulate (QAM) a carrier signal for application to a trans- 
mission antenna. 40 

Compressor 17 is conditioned by the system con- 
troller 14 to compress the odd fields of video data 
according to a predetermined sequence of intraframe 
and interframe encoding modes, e.g., I, B, P. The mode 
sequence may be similar to the mode sequence applied 45 
to the even fields, or it may be an alternative sequence. 
In either event the mode sequence applied to the odd 
fields is selected so that intraframe encoded odd fields 
occur approximately midway between intraframe 
encoded even fields, or vice versa. 50 

Compressed odd field video data provided by the 
compressor 1 7 is coupled to the transport packetizer 
circuit 20, via a buffer memory 1 9. 

The transport packetizer circuit is conditioned by 
the control circuit 14 to alternately operate on even ss 
fields of compressed data provided by the buffer 18 and 
odd fields of compressed data provided by the buffer 1 9. 

The buffers 18 and 19 are included because the 
amount of compressed data for respective fields differ 



according to the compression mode employed and the 
detail attendant the image represented by the field of 
video data. The differences in amounts of data result in 
fields of compressed data occupying different time inter- 
vals, and thus data output by the compressors 16 and 
1 7 may not occur at convenient times for interleaving 
the odd and even fields of compressed data. The buffers 
provide accommodation for the differences in occur- 
rence of the compressed data provided by the respec- 
tive compressors. 

The apparatus of FIGURE 2 is shown with first and 
second separate compression circuits for compressing 
the even and odd fields of data. It should be appreciated 
that a single compressor may be employed to perform 
compression of both the even and odd fields. 

FIGURE 3 illustrates an exemplary compressor 
apparatus which may be utilized for compressing both 
even and odd fields according to the sequence illus- 
trated in FIGURE 1C. The assumption is made that 
source fields of video signal have been rearranged to 
occur in the numbered sequence shown in FIGURE 1C. 
The compressor provides compressed data according 
to I, B, P modes. Intraframe compression consists of 
performing discrete cosine transforms over 8X8 blocks 
of pixels and then variable length encoding the trans- 
form coefficients. Predictive compression (P fields) con- 
sists of determining motion vectors which indicate 16 X 
1 6 blocks of pixels from a prior I field which most closely 
correspond to 16 X 16 blocks of pixels in the current 
field. A predicted field is generated using the motion 
vectors and data from the prior I field, and the predicted 
field is subtracted from the current field on a pixel by 
pixel basis to generate residues. A discrete cosine 
transform is then performed on 8 x 8 blocks of the resi- 
dues. The transform coefficients of the residues are var- 
iable length encoded, and the motion vectors plus the 
residue coefficients are non additively combined to form 
coded P fields. Bidirectional predictive fields (B) are 
formed similarly to the P fields except that the motion 
vectors and corresponding residues are associated with 
both prior occurring and subsequent fields of video 
data. 

The apparatus shown only includes the circuitry 
required to generate compressed luminance data. Sim- 
ilar apparatus is required to generate compressed 
chrominance U and V data. In FIGURE 3 the memory 
and storage elements 101, 102, 1 14 and 1 15 are each 
arranged to store an odd field of data and an even field 
of data in separate memory sections. When an even 
(odd) field is being processed the sections of the 
respective memory and storage elements designated 
for storing even (odd) fields are accessed. In addition 
there are elements 104 and 105 designated as ele- 
ments for computing forward and backward motion vec- 
tors respectively. Since whether a motion vector is 
forward or backward depends only upon whether the 
current field is analyzed with respect to a prior or suc- 
ceeding field, both elements are realized with similar cir- 
cuitry, and in fact both elements 104 and 105 alternate 
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on a field/frame basis between generating forward and 
backward vectors. The elements 104 and 105 may be 
realized using integrated circuits of the type designated 
STI 3220 MOTION ESTIMATION PROCESSOR availa- 
ble from SGS-THOMSON MICROELECTRONICS. In 
order to achieve the necessary processing rates each of 
the elements 104 and 105 may comprise a plurality of 
such integrated circuits operating simultaneously on dif- 
ferent areas of respective images. 

Element 109 designated DCT & Quantize performs 
the discrete cosine transform and quantization of trans- 
form coefficients and may be realized using integrated 
circuits of the type designated STV 3200 DISCRETE 
COSINE TRANSFORM available from SGS-THOM- 
SON MICROELECTRONICS. Element 109 may also be 
realized with a plurality of such devices operated in par- 
allel to concurrently process different areas of the 
image. 

Even and odd fields occur alternately and sequen- 
tially, and the compressor of figure 3 alternately com- 
presses odd and even fields. Compression of even and 
odd fields is similar except for the relative sequence of 
intra and interframe compression modes. The 
sequence is programmed into the controller 1 16 for both 
even and odd field sequences, and communicated to 
the respective processing elements via a control bus 
CB. Since the compression function is conceptually the 
same for both even and odd field sequences an expla- 
nation of only the even field compression will be pro- 
vided below. 

Refer to FIGURE 1 C and assume that even field 1 0 
is currently available. Previously occurring even P field 4 
has been snatched and stored in the even field section 
of the buffer memory B 101. In addition a previously 
generated predicted even field 4 has been stored in the 
even field section of one of the buffer storage elements 
114 or 115. As field 10 occurs it is stored in the even 
field section of the buffer memory A, 102. In addition 
field 10 is applied to a working buffer memory 100. As 
field 10 occurs, appropriate blocks of image data are 
coupled from the memory 100 to the minuend input of a 
subtracter 108. During compression of the I fields the 
subtrahend input of the subtracter 108 is held at a zero 
value so that data passes through the subtracter 108 
unaltered. This data is applied to the DCT and quantizer 
element 1 09 which provides quantized transform coeffi- 
cients to elements 1 10 and 1 12. Element 112 performs 
inverse quantization and inverse DCT transformation of 
the coefficients to generate a reconstructed image. The 
reconstructed image is applied via an adder 1 1 3 to, and 
stored in, the even field section of one of the buffer stor- 
age elements 114 and 1 15 for use in compressing sub- 
sequent B and P fields. During compression of I frames 
no information is added (by adder 113) to the recon- 
structed image data provided by element 1 1 2. 

Element 110 performs variable length encoding 
(VLC) of the DCT coefficients generated by element 
109. The VLC codewords are applied to a formatter 1 1 1 
which segments the data and appends appropriate 



header information to facilitate decoding. Coded data 
from element 1 1 1 is then passed to a further buffer 
memory (not shown). The formatter may also be 
arranged to provide field indicia to the transport pack- 
5 etizing circuit for generating corresponding transport 
block headers. Each of the elements 109, 110 and 1 1 1 
are controlled by the system controller 1 16 to cyclically 
perform the appropriate operations at the appropriate 
times. 

10 After the occurrence and compression of even field 
10 an even field 6 (B) occurs and is loaded into buffer 
memory 100. Data from even field 6 is coupled to both 
of elements 104 and 105. Element 104, responsive to 
data from even field 6 stored in memory 100 and data 

is from even field 4 stored in memory 101, calculates for- 
ward motion vectors for respective blocks of 16 x 16 pix- 
els of image data. It also provides a distortion signal 
which is indicative of the relative accuracy of the respec- 
tive forward motion vectors. The forward motion vectors 

20 and the corresponding distortion signals are coupled to 
an analyzer 106. 

Element 1 05, responsive to data from field 6 stored 
in memory 100 and data from I field 10 stored in mem- 
ory 102, generates backward motion vectors and corre- 

25 sponding distortion signals which are also coupled to 
the analyzer 106. Analyzer 106 compares the distortion 
signals against a threshold, and if both exceed the 
threshold, provides both the forward and backward 
motion vectors as the motion vector, and also provides 

30 a corresponding signal related to the ratio o1 the distor- 
tion signals. Upon reconstruction predicted images are 
generated using both forward and backward vectors 
and corresponding field data from which derived. An 
interpolated field is generated from the forward and 

35 backward predicted fields in accordance with the ratio of 
distortion signals. If the distortion signals for both the 
forward and backward motion vectors are less than the 
threshold, the motion vector with the corresponding 
lesser valued distortion signal is selected as the block 

40 motion vector. 

After the motion vector has been determined, it is 
applied to the motion compensated predictor 107 which 
accesses the appropriate data block defined by the vec- 
tor or vectors from the previously regenerated field 10 or 

45 field 4 or both, stored in the even field sections of the 
storage elements 114 and 115. This data block is 
applied to the subtrahend input of the subtracter 108 
wherein it is subtracted on a pixel by pixel basis from the 
corresponding block of pixel data from the current field 

so 6 provided by the buffer memory 1 00. The differences or 
residues are then encoded in element 109 and the coef- 
ficients applied to element 110. The corresponding 
block vector is also applied to element 1 10. The motion 
vectors are variable length encoded in element 110. 

55 The coded vectors and coefficients are then transferred 
to the formatter 111. The encoded B fields are not 
inverse quantized and inverse transformed in element 
1 12 since they are not used for subsequent encoding. 
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P fields are similarly encoded except that only for- 
ward motion vectors are generated. For example P field 
16 is encoded with motion vectors associating corre- 
sponding blocks of I field 10 and P field 16. During 
encoding of P fields, element 1 12 provides correspond- 
ing decoded residues and element 107 provides the 
corresponding predicted P field. The predicted field and 
the residues are added in adder 1 13 on a pixel -by-pixel 
basis to generate the reconstructed field which is stored 
in the even field section of the one of storage elements 
114 and 116 not containing the even field information 
from which the predicted even P field is generated. The 
reconstructed and stored even P field is used for encod- 
ing subsequent even B fields. For both P and B fields it 
should be noted that DCT's are performed on a block 
basis (e.g., a matrix of 8 x 8 pixels) but motion vectors 
are calculated for macroblocks (e.g., a 2 x 2 matrix of 
luminance of blocks or a 1 6 x 1 6 matrix of pixels). 

FIGURE 4 illustrates an exemplary receiver appa- 
ratus for processing transmitted compressed video sig- 
nal occurring as interleaved odd and even fields which 
have been independently encoded in sequences of 
intraframe and interframe encoding modes. The trans- 
mitted signal is detected by a detector 40 which may 
include a tuner, IF circuitry and a QAM demodulator. 
Detector 40 provides a signal in conformance with the 
signal provided by the transport packetizer 20 of FIG- 
URE 2. This signal is coupled to a transport processing 
circuit 43. Transport processing circuit 43 includes an 
error check/correction circuit, which, responsive to the 
error check codes appended to the transmitted signal, 
corrects signal errors incurred during transmission. If 
uncorrectable errors occurred a flag is generated and 
communicated to the receiver system controller 42. The 
transport processor 43, responsive to transport header 
information included in the transport blocks, identifies 
odd and even fields of data, and reconfigures the trans- 
mitted signal from transport block format, to a format 
which is in conformance with compressed information 
provided by the buffers 18 and 19 of FIGURE 2. The 
reconfigured data is coupled to a multiplexer 44. A con- 
trol signal, corresponding to the current field type 
(odd/even) is provided by the transport processor 43 to 
condition the multiplexer 44 to pass odd field data to a 
decompressor 45 and even field data to a decompres- 
sor 46. The decompressors 45 and 46 perform decom- 
pression of the odd and even field compressed video 
data respectively, and provide decompressed video sig- 
nal to buffer memories 47 and 48. 

In this example it is assumed that the compressed 
signal is of the form illustrated in FIGURE 1C, but that 
the decompression circuitry 45 and 46 provide decom- 
pressed data reordered in the normal field sequence as 
per FIGURE 1 B, for example. The reordered fields from 
buffer memories 47 and 48 are coupled to a multiplexer 
51 which, in the steady state with no loss or corruption 
of data, alternately couples odd and even fields of data 
to a video display RAM 52. It is assumed that the display 
RAM has sufficient storage capacity to hold one frame 



of data. Frames of data are thereafter read from the dis- 
play RAM in ether interlaced or non interlaced format for 
display purposes. The receiver apparatus is controlled 
by the controller 42 which is programmed to coordinate 
s the decompression and display of received video data 
according to a normal cycle of operations. 

Immediately after system turn-on or channel 
changes effected by user control 41 , the system control- 
ler 42 initiates a start-up cycle to provide image repro- 
io duction as quickly as possible. Once image display of a 
full sequence of fields of data (a sequence encompass- 
ing two successive intraframe encoded mutually exclu- 
sive odd or even fields) has been accomplished, the 
controller switches to the normal decompression cycle 
15 of operation. At start-up, image reproduction cannot 
occur until at least one intraframe encoded field is 
received, since reproduction of interframe encoded 
fields (P or B) require data from an intraframe encoded 
field. The controller 42 monitors the field types received 
so responsive to header data provided by the transport 
processor 43. The controller precludes display of 
received field data until an intraframe encoded field is 
detected. Its field type (odd or even) is checked and 
decompression is performed on the successive fields of 
25 the same type as the first occurring intraframe encoded 
field. Display of fields of the opposite field type is fore- 
stalled until the occurrence of the first occurring intra- 
frame encoded field of that type, which occurs a known 
number of fields after the detection of the first intraframe 
30 encoded field. At start-up, display of the first decom- 
pressed I frame may be repeated for the number of 
frame intervals between an I encoded field and the first 
B encoded field following the first P encoded field occur- 
ring after the I encoded field. Note in FIGURE 1C, if field 
35 10 is the first occurring I encoded field, the B fields 6 
and 8 cannot be decoded without the prior P encoded 
field 4, (which is not available). The next even field to be 
displayed after the I field 10 in the normal display field 
sequence is field 12 which occurrs four frame intervals 
40 after field 10. Alternatively, rather than repeatedly dis- 
playing the first occurring I field the image display may 
be inhibited for e.g. four frames following the occurrance 
of the first I field. 

During channel changes the system may be condi- 
45 tioned to repeatedly display the last image from the prior 
channel until the system has synchronized to display 
images from the newly selected channel. 

Assume that the first intraframe encoded field is 
odd. Successive odd fields are decompressed and pro- 
50 vided by the buffer memory 47 to the multiplexer 51 . At 
this juncture several options are available regarding dis- 
play of the received data. The first is to write the odd 
fields to the odd field lines of the display RAM 52, and to 
set the even field lines of the display RAM to an, e.g., 
55 intermediate gray value, and display the image. A sec- 
ond is to write the odd field data to the odd field lines of 
the display RAM then read the same odd field data from 
the buffer memory 47 a second time, and write it to the 
even field lines of the display RAM, and display the 
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image. The second option wilt provide a brighter image 
than the first option and with apparent greater resolu- 
tion. A third option is to write the odd field data to the 
odd field lines of the display RAM, then to read the 
same field from the buffer memory 47 and apply same 5 
to an interpolator 50 via a multiplexer 49. The interpola- 
tor 50 may be arranged to generate interpolated lines of 
data from successive pairs of lines of the odd field sig- 
nal (vertical averaging), thereby producing pseudo even 
lines of data which are subsequently written to the even w 
field lines of the display RAM 52. This option will pro- 
duce images which have apparent greater resolution 
than the second option. 

The particular option employed is programmed into 
the controller 42, and is part of the start-up cycle. The 15 
controller, responsive to the data provided by the trans- 
port processor 43, controls the reading of the data from 
the appropriate buffer memory 47 or 48 (depending 
whether the first intraframe encoded field is odd or 
even) and controls the switching of the multiplexers 49 20 
and 51 . For example, considering the third option and 
assuming that the first intraframe encoded field is odd, 
the buffer memory 47 is conditioned to read each field of 
signal twice, the multiplexer 49 is conditioned to pass 
signal from buffer memory 47, and the multiplexer 51 is 25 
conditioned to alternately pass fields of signal from the 
buffer memory 47 and the interpolator 50. After a prede- 
termined number of fields have been processed in this 
manner the controller switches to the steady state con- 
trol cycle to decompress data from both odd and even 30 
field types. 

As indicated earlier, the transport processor may 
provide error flags indicative of lost or uncorrectable 
errors. To ameliorate potential unacceptable image cor- 
ruption from such errors or lost data, the controller may 35 
be arranged to condition the receiver system to substi- 
tute noncorrupted signal. For instance, if the lost or erro- 
neous data occurs in an intraframe encoded field, the 
controller may be arranged to revert to processing simi- 
lar to the above described option three (except that 40 
there is no need to wait for a first intraframe encoded 
field, assuming that the lost data only occurred in an 
odd or an even field; alternatively if data is lost in both 
odd and even fields, the controller will revert to the start- 
up cycle), tf data is lost in a P field the controller may 45 
again be arranged to condition the system to operate as 
per option three. Alternatively, if data is lost from a B 
field, the controller may be arranged to condition the 
system to replace this data, on a single field basis, or 
partial field basis, with interpolated data as per options so 
two or three. 

FIGURE 5 illustrates an exemplary arrangement of 
a single decompression apparatus for decompressing 
both even and odd field data. 

Generally the circuitry of FIGURE 5 is arranged to ss 
decompress video data provided in MPEG-like format. 
The apparatus includes two buffer memories 314 and 
316, each of which has memory capacity to store an 
odd field and an even field of decompressed image 
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data. When odd (even) fields are being decompressed 
the odd (even) field portions of the memories are ena- 
bled and vice versa. Decompressed data is provided by 
an adder 312, and is applied to a multiplexer 320 and 
the memories 314 and 316. When B fields are being 
decompressed, this image data is passed by the multi- 
plexer 320 from adder 312 to the display RAM 318 (via 
multiplexer 322). When I or P fields are decompressed 
the decompressed image data is written to one of the 
buffer memories 314 or 316, and passed to the display 
RAM after decompression of the subsequently occur- 
ring B fields (via multiplexers 320 and 322). In this way 
the transmitted field sequence is reordered to the nor- 
mal field sequence. Nominally the multiplexer 322 is 
conditioned to pass image data from the multiplexer 320 
to the display RAM 318. During intervals when error 
concealment is required, the multiplexer 322 is condi- 
tioned to pass image data from a field memory 324. 
Error concealment is provided according to the aforede- 
scribed option three. As each field of data is provided by 
the multiplexer 320 an interpolated field of image data is 
generated from the current field and stored in the field 
memory 324 for substitution in whole or in part in the 
next occurring field. During start-up or channel 
changes, fields of data are alternately applied to the dis- 
play RAM from the multiplexer 320 and the field memory 
324. 

Compressed video data from the transport proces- 
sor 43 is applied to a buffer memory 300. This data is 
accessed by the decompression controller 302 wherein 
header data is extracted to program the controller 302. 
The variable length codewords corresponding to DCT 
coefficients are extracted and applied to a variable 
length decoder (VLD) 308 and the variable length code- 
words corresponding to motion vectors are applied to 
the variable length decoder (VLD) 306. The VLD 308 
contains apparatus for performing variable length 
decoding, and inverse run length decoding as appropri- 
ate under the control of the controller 302. Decoded 
data from the VLD 308 are applied to an inverse DCT 
circuit 310 which includes circuitry to inverse quantize 
the respective DCT coefficients and to convert the coef- 
ficients to a matrix of pixel data. The pixel data is then 
coupled to one input of an adder 312, the output of 
which is coupled to the multiplexer 320 and the buffer 
memories 314 and 316. 

The VLD 306 includes circuitry to decode the varia- 
ble length encoded motion vectors under the control of 
the controller 302. Decoded motion vectors are applied 
to a motion compensated predictor 304. Responsive to 
the motion vectors the predictor accesses correspond- 
ing blocks of pixels stored in one (forward) or both (for- 
ward and backward) of the buffer memories 314 and 
316. The predictor provides a block data (from one of 
the buffer memories) or an interpolated block of data 
(derived from respective blocks from both buffer memo- 
ries) to a second input of the adder 312. 

Decompression is performed as follows. If a field of 
input video data is intraframe encoded there are no 
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motion vectors and the decoded DCT coefficients corre- 
spond to blocks of pixel values. Thus for intraframe 
encoded data the predictor 304 applies a zero value to 
the adder 312 and the decoded DCT coefficients are 
passed unaltered by the adder 312, to the one of the 
buffer memories 314 and 316 not storing the last 
decompressed P field, for decoding subsequent motion 
compensated frames (B or P). 

If a field of input data corresponds to a forward 
motion compensated P field, the decoded DCT coeffi- 
cients correspond to residues or differences between 
the present e.g. even field and the lastmost occurring 
even I or P field. The predictor 304 responsive to the 
decoded motion vectors accesses the corresponding 
block of I or P field data stored in either buffer memory 
314 or 316 and provides this block of data to the adder 
wherein the block of residues are added to the corre- 
sponding block of pixel data provided by the predictor 
304. The sums generated by the adder 312 correspond 
to the pixel values for the respective blocks of the P 
field, which pixel values are applied to the one of buffer 
memories 314 and 316 not storing the I or P field of pixel 
data utilized to generate the predicted pixel data. 

For bidirectionally encoded (B) fields the operation 
is similar, except that predicted values are accessed 
from the stored I and P pixel data stored in both buffer 
memories 314 and 316 depending upon whether the 
respective motion vectors are forward or backward vec- 
tors or both. The generated B field pixel values are 
applied via the multiplexer 320 to update the display 
RAM 318. but are not stored in either of the buffer mem- 
ories 314 and 316, as B field data is not utilized for gen- 
erating other fields of picture data. 

During start-up and channel changes the image 
latency may be shortened with insignificant image 
errors. Assume that field 10 (FIGURE 1C) is the first 
occurring I field after start-up or channel change. In 
order to decompress the subsequent B fields 6 and 8 a 
decompressed P field 4 is required, which of course is 
not available. However it is generally assumed that suc- 
cessive fields/frames of image data are significantly 
redundant. Thus decompressed I field 10 should be 
similar to decompressed P field 4 and may be substi- 
tuted therefor. This is accomplished simply by writing 
the first decompressed I field to both of the memories 
314 and 316. Thereafter B fields 6 and 8 may be 
decompressed and displayed. 

The controller 302 is programmed to cycle the par- 
ticular processing elements according to the particular 
sequence of received odd and even fields. It is also pro- 
grammed with start-up and channel change sequences 
which are initiated responsive to control signals pro- 
vided on the control bus CB from the system controller. 
During start-up, display is inhibited until the reception of 
the first I field. Its type (odd/even) is determined from 
the header data provided in the received signal, and 
responsive to the type data, only the odd or even fields 
are provided to the multiplexer 320 for a predetermined 
number of field intervals. During this period the multi- 



plexer 322 is conditioned to switch at the field rate to 
provide fields of real image data provided by the multi- 
plexer 320 interleaved with interpolated fields of data 
provided by the field memory 324. During channel 
5 changes the system may be conditioned to operate in 
similar fashion, or rather than inhibiting display until 
reception of an I field, may provide a frozen display of 
data stored in the display RAM from the lastmost 
received channel. 

The interpolator 323 has been described as a spa- 
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tial interpolator which averages lines within a particular 
field. It should be appreciated that the interpolator 323 
may be arranged to generate temporally averaged data 
from the current field and a prior field of the same type 
15 (odd or even). 

Concealment of intermittent data loss, indicated by 
the error indications provided by the transport processor 
43 may be implemented by simply conditioning the sys- 
tem to enter the channel change mode of operation. 
20 Concealment of this type will introduce jerkiness and 
other display artifacts. However if the data lost or cor- 
rupted occurs in a B field, the B fields may be substi- 
tuted with interpolated fields without significant 
disturbance to the displayed image. 
25 Refer to FIGURE 6 which illustrates the coding hier- 
archy of the compressed signal. At the top level the 
compressed signal is provided as groups of fields GOFi 
(odd or even), each of which includes at least one I field. 
Each field is divided into slices. A slice includes a plural- 
30 ity of macroblocks. Each macroblock comprises both 
luminance ,Y, and chrominance ,U,V, data. This data is 
arranged in blocks with each block comprising informa- 
tion from an 8 X 8 array matrix of image pixels. As such 
each macro block includes information from 16 adjacent 
35 field lines of the encoded image. Where appropriate the 
macroblocks also include motion vectors and other indi- 
cia required for decoding. 

For purposes of discussion assume that the trans- 
port packetizer 20 applies error detection codes to the 
40 compressed data on a slice basis so that transmission 
errors may be detected limited to at least respective 
slices. Given this data configuration, localized error con- 
cealment may be performed in the receiver on a slice 
basis. Note however, that if an error occurs in a slice of 
45 an I or P field, this error may propagate through the 
remainder of the GOF. Thus when error concealment is 
performed, attention must be paid to the type of field in 
which the error occurred. 

In the receiver the system controller 42 may include 
so an error memory for storing error indications of respec- 
tive slices of respective fields, which error indications 
are provided by the transport processor 43. Consider 
FIGURE 7 which illustrates an error memory (included 
within the system controller 42) having sufficient capac- 
55 ity to store slice error data for a GOF. Each column of 
the field error memory represents slice error data for a 
particular field in the GOF. The type of each respective 
field is indicated by the letters I.B.P at the top of each 
column. Consider column 1 which contains error data 
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for an I field of the GOR A "1 " in a memory location indi- 
cates that an error was detected in a corresponding 
slice and a "CT indicates absence of errors. An error has 
been indicated in slice 3. This error may propagate 
through all the remaining fields in the GOF during 
decompression. Thus the error indication must be prop- 
agated in the error memory, if proper error concealment 
is to be provided. The error indication propagation is 
indicated by the arrow in slice 3 from column 1 to col- 
umn 9. Similarly propagation of error indications for P 
fields is indicated by respective arrows in the memory. 
(The memory bank was not fully populated with ones 
and zeroes to avoid confusion.) 

Propagation of error indications in the field error 
memory may be accomplished with the use of an addi- 
tional working memory designated l/P. In general terms, 
the I field slice error data is loaded in both the I field por- 
tion of the field error memory and in the l/P memory. As 
B field slice error data is generated it is ORed with the 
corresponding slice error data in the l/P memory, and 
the result loaded in the respective B field portion of the 
field error memory. As subsequent P field slice error 
data is generated, this data is ORed with corresponding 
slice date in the l/P memory, the results are loaded in 
the respective P field portion of the field error memory, 
and the results are also used to replace corresponding 
slice error data in the l/P memory. In this fashion both I 
and P field slice error data is propagated through 
respective fields of the field error memory for a GOF. 

FIGURE 8 shows a flowchart of the process for 
generating the error map. Respective error maps are 
generated for both odd and even groups of fields, how- 
ever the flow chart shows the process for generating a 
map for only an odd or even GOF. Typically this process 
is initialized by entering the steady state decompression 
cycle. Once initialized the system waits for a field syn- 
chronization pulse (600). and then reads the field type 
data in the header of a transport packet (601). The field 
type is examined (602) to determine if it is an I encoded 
field. If it is an I field, a counter (607) is reset to zero, and 
slice error indications are loaded into the I portion of the 
field error memory (FEM), and is ORed with corre- 
sponding slice error data in the l/P memory. The results 
of ORing are substituted in the l/P memory (603). Note 
that the l/P memory is not loaded with I field slice error 
data on the occurrence of an I field because e.g. two 
subsequent B fields from the previous GOF are yet to be 
decompressed. I field error data is substituted in the l/P 
memory after reception of these B fields. This is accom- 
plished by counting (607) field synchronization pulses, 
and when the appropriate number of fields (608) have 
occurred after the reception of an I field, the slice error 
data for that I field is read from the FEM to the l/P mem- 
ory (609). 

If the received field is not an I encoded field it is 
checked (604) to determine if it is a P encoded field. If it 
is a P encoded field, the slice error data is ORed (605) 
with corresponding slice error data in the l/P memory, 
and the results are loaded in both the l/P memory and 



the appropriate P field portion of the FEM. If the 
received field is not a P encoded field, by default it is a 
B encoded field. The slice error data is ORed (606) with 
the corresponding slice error data in the l/P memory, 

5 and the results are loaded in appropriate B field loca- 
tions of the FEM. 

The foregoing process for generating error maps 
provides error data which permits concealing errors 
which propagate temporally in a group of frames and 

10 horizontally within a slice. However, it should be real- 
ized, that due to image motion, errors may also propa- 
gate vertically within successive fields. Concealment of 
vertical error propagation may be accomplished by ver- 
tically spreading the slice error data. For example, if a 

75 slice error occurs in slice 3 of e.g. I field 1 , this error indi- 
cation may also be included in memory error locations 
corresponding to slices 2 and 4. Typically, for most 
images, motion occurs predominantly in the horizontal 
direction with only slight motion in the vertical direction. 

20 Thus, vertical error propagation may generally be 
ignored with only very slight and insignificant conse- 
quent image corruption. 

The error map data is provided to e.g. the decom- 
pression controller 302 and responsive thereto eondi- 

25 tions the multiplexer 322 to substitute interpolated slices 
from the prior field to the display RAM 318, for current 
slices of decompressed image data which have been 
indicated to contain errors. 

FIGURE 9 illustrates a flow chart of an exemplary 

30 start-up/channel change sequence for the system con- 
troller 42. During start-up or channel changes flags are 
generated. These flags are examined (300) to deter- 
mine whether start-up or a channel change is to be 
effected. If the start-up mode is requested, display of 

35 image data is inhibited and a field counter (303) is disa- 
bled (301). Alternatively if a channel change is 
requested, the display apparatus is conditioned to 
repeatedly display image data contained in the display 
RAM, and the field counter (303) is disabled. The sys- 

40 tern waits (302) for the next field synchronization pulse, 
and when it occurs, transport header data is examined 
(305). The system waits for the occurrence of an I 
encoded field (306), which field is examined for its 
odd/even field type (307). At the occurrence of an I field 

45 the counter (303) is enabled. If the I field is an even field 
it is decompressed (308), but not written to the display 
RAM until the reception of a predetermined number, N, 
of fields (309). The number N is established to conform 
to the delay interval between reception of an I field and 

so the time required to provide continuous decompressed 
fields. After reception of N fields, the decompressed 
data is written to the display RAM, and the display mode 
is enabled (312). In addition interpolated odd fields, 
generated from the decompressed even fields are writ- 

55 ten to the display RAM. This mode continues until M 
fields have been received (315), at which time the 
steady state decompression mode (316) is activated. 
The number M is selected as that number of fields after 
the occurrence of an even (odd) field that valid decom- 
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pressed odd (even) field data will be available. For 
example, with respect to FIGURE 1C, the number M will 
be equal to N+9 fields. 

Similarly if the first detected I encoded field is odd 
(307), a similar process (310, 311, 314, 315, 316) is fol- 
lowed. 

The system follows a similar sequence if a channel 
change is requested with the only difference being that 
the display is not inhibited. At control points (312) or 
(314), since the display has not been inhibited, when 
new data is written to the display RAM, image change is 
automatic. 

Claims 

1. A video signal processor apparatus of the type for 
decompressing a compressed image representa- 
tive signal which has been compressed in groups of 
frames, with at least the first frame in each group of 
frames having been intraframe encoded, and ones 
of the remaining frames of each group having been 
predictive encoded, and wherein frames of respec- 
tive groups of frames from which other frames have 
been predictive encoded are herein designated as 
anchor frames, said compressed image represent- 
ative signal occurring in segments of data of less 
than a frame and susceptible of incurring errors 
during transmission, said segments including error 
check bits from which errors in segments may be 
detected, said apparatus comprising; 

error detection/correction means, respon- 
sive to said compressed image representative sig- 
nal, for detecting errors in respective segments of 
data which are not correctable and generating error 
indications E for respective segments of data con- 
taining such errors; 

means responsive to said error indications E 
for mapping said uncorrectable errors in an error 
map, and propagating error indications E of said 
anchor frames, into corresponding map locations of 
successive anchor frames within a group of frames; 
and 
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The apparatus set forth in any preceding claim, 
wherein said means for providing substitute data 
includes: 

means responsive to said detected seg- 
ments of data for generating decompressed image 
data; 

an interpolator, responsive to said decom- 
pressed image data, for generating an interpolated 
signal from error free image data; and 

means for applying decompressed image 
data to a utilization means in the absence of error 
indications, and responsive to error indications in 
said error map for applying interpolated image data 
to said utilization means. 

5. The apparatus set forth in any of claims 1 to 3, 
wherein odd and even fields of respective frames 
are independently compressed, and are independ- 
ently decompressed in said video signal processor 
and said means for providing substitute data 
includes, means responsive to error indications in 
said error map for substituting decompressed odd 
field image data for decompressed even field image 
data corresponding to segments of compressed 
data having uncorrectable errors. 

6. The apparatus set forth in claim 1 wherein said 
means for mapping said uncorrectable errors and 
said means for propagating said error indications 
includes an error map memory and a working mem- 
ory. 



means responsive to said propagated error 
indications for providing substitute image data for 
portions of respective frames having errors indi- 45 
cated by the mapped indications E. 



2. The apparatus set forth in claim 1 wherein said 
means for propagating error indications includes 
means for ORing error indications of a current so 
anchor frame with error indications at correspond- 
ing spatial locations of prior anchor frames within a 
group of frames. 



3. The apparatus set forth in claim 2 wherein said 55 
means for propagating error indications includes 
means for propagating said error indications into 
locations corresponding to vertically adjacent 
image areas. 
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